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Abstract 


Introduced recently, the common product between two multisets or functions represented as multisets (multifunc- 
tions) can be understood as being analogue to the inner product in real vector or function spaces. In addition to 
providing resources for quantifying joint variations as well as the similarity between clusters in pattern recognition, 
the common product also allows a respective multiset convolution/correlation to be derived which, in addition to its 





conceptual and computational simplicity, has been verified to be able to provide good results in tasks such as template 
matching, tending to yield peaks that are sharper than those obtained by standard cross-correlation, while also atten- 
uating substantially secondary matching peaks. Given that the multiset convolution can be adapted to employ other 
similarity functionals, such as the coincidence and addition-based multiset Jaccard index, it remains an interesting 
subject to compare how multifunction convolutions based on these alternative implementations of the multifunction 
convolution perform. The present work addresses this subject, with encouraging results that can have immediate appli- 
cations not only in pattern recognition and deep learning, but also in scientific modeling in general. As expected, the 
multifunction convolution methods presented enhanced performance, characterized by sharper peaks while secondary 
peaks are attenuated, which was maintained even in presence of increasing levels of noise. In particular, the two 
methods derived from the coincidence index led to the sharpest and narrowest peaks, as well as intense attenuation of 
the secondary peaks. The cross correlation, however, presented the best robustness to noise, which suggested a new 
method in which the cross-correlation is applied prior to the multifunction convolution methods, therefore allying the 
best characteristics of each of these two families of methods. 


‘Deep inside the mirror, a whole universe of similarities.’ 


LdaFC 


1 Introduction 


The Jaccard index (e.g. |1, 2, 3]) has been extensively 
used in many areas as an interesting and effective means 
for comparing any two sets. A multiset Jaccard index, in 
which multisets (e.g. [4, 5, 6, 7, 8, 9|) are taken instead of 
sets, has also been used in similar applications, with the 
ability to take into account the multiplicities of multiset 
elements. More recently [3], several further generaliza- 
tions of the Jaccard index have been proposed based on 
several respective motivations. 





In another recent work [10], multisets have been ex- 
tended to cope with negative and real-valued multiplici- 
ties, which allowed the identification of the multiset uni- 
verse as corresponding to the multiset with all multiplici- 


ties null. As a consequence of the definition of the multiset 
universe, the complementation operation becomes possi- 
ble, allowing results such as the De Morgan theorem to 
be incorporated into multiset theory. In addition, these 
two extensions paved the way to extending multisets to 
represent generic functions and scalar/vector fields [10, 3], 
leading to the concept of multifunctions. 

Multifunctions, however, require an adaptation of the 
intersection multiset operation in order to properly take 
into account the relative signs of the multifunctions. Re- 
flecting an analogy with the traditional inner product of 
vectors or functions, which can also be understood as 
quantifications of similarity, the adapted multiset intere- 
section has been called the common product |10, 3). 

The common product can be readily applied not only 
to quantify the similarity between two clusters in pattern 
recognition, but also be employed as a joint variation mea- 
surement similar to the Pearson correlation coefficient. 
Preliminary results [3] indicate that the common prod- 


uct provides a purportedly quantification of joint varia- 
tion between two random variables that is more compati- 
ble with human perception than product-based measure- 
ments such as the Pearson correlation coefficient, espe- 
cially given the tendency of the latter to saturate as the 
correlation increases [3]. 

The common product also allowed the definition of a 
convolution/correlation between two multifunctions [10, 
3|. As with its real function counterpart, the multi- 
function convolution can be employed for typical signal 
processing tasks, including but not being limited to fil- 
tering and template matching. Indeed, preliminary re- 
sults [3, 10] have been obtained that are particularly 
promising and encouraging. More specifically, when used 
for template matching, the obtained peaks corresponding 
to the maximum similarity between the target and tem- 
plate functions are not only substantially sharper, but 
also the secondary matching peaks result much more at- 
tenuated [10]. The combination of these two features sug- 
gests that the multifunction convolution has substantial 
potential for applications in pattern recognition and deep 
learning, as well as other related areas involving estima- 
tions of similarity and/or convolutions. Actually, the lin- 
ear part of neurons in artificial neuronal network can be 
made to correspond to combined products, instead of the 
traditional inner product of inputs. 

Since the multifunction convolution is based on the 
functional of the common product for several relative dis- 
placements between the two involved multifunctions, it 
becomes of particular interest to adopt alternative simi- 
larity indices, such as those proposed in [3]. That consti- 
tutes the main purpose of the present work. More specif- 
ically, we compare several multifunction convolutions de- 
rived from the generalized Jaccard indices presented and 
developed in [3]. 

We start by reviewing the adopted indices, then pro- 
ceed to a numeric comparison of the respectively obtained 
multifunction convolutions with respect to two multifunc- 
tions, while also considering progressive levels of additive 
noise. 


2 The Considered Similarity In- 
dices 


We start with the traditional cross-correlation between 
two functions f(x) and g(a): 


Corf o)l = | ise 


The basic Jaccard index between two sets with non- 


negative multiplicity can be defined as: 


_|AnBl 





where A and B are any two sets to be compared. It 
can be verified that 0 < 7(A, B) <1. 
The homogeneity or interiority index can be expressed 





as: 
IAN B| 


Aero (3) 
min {|A| , |B|} 

with0 < Z(A, B) < Land0 < J(A, B) < H(A, B) < 1. 
The combination of the basic Jaccard and the interior- 


T(A, B) = 


ity indices yields the coincidence index, proposed in [3] 





as: 
C(A, B) = F(A, B) T(A, B) (4) 
which can also be expressed in expanded form as: 
AN B|? 
C(A, B) = ae Gen (5) 


— |AUB] min {|A], |B|} 


again with 0 < C(A, B) < 1. 
The Jaccard index extended to multisets with non- 








negative multiplicities can be expressed as: 


So min (ai, bi) 
4 max (a;, bi) 

with 0 < Jm(A, B) <. Therefore, this index is capable 
of taking into account the multiplicity of the elements in 


Jm(A, B) = (6) 


the involved multisets. 

The extension of the Jaccard index to negative, real- 
valued multiplicities, involves the following develop- 
ments [3, 10]. In particular, the intersection between two 
multisets with positive and/or negative values now re- 
quires the application of a binary operator analogous to 
the inner product in function spaces, in which the multi- 
plicities are properly mirrored among the four quadrants 
depending on their signs |10, 3]. This operator, which will 








be referenced here as common product, can be expressed 
as: 


< f(x), g(x) >= | 
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From which, the 
(mconvolution) of two functions can be derived: 


FD f 


— OO 


multifunction convolution |10, 3| 


OO 


K flx)glz—-y)>dr (8) 
It is also possible [10] to write: 


f(a) Oso) = f “tities © 


Now, the multifunction convolution, when normalized 
by the magnitude of the multifunctions, yields: 


f(a)Og(x)[yl = J ~ < f(z), g(@ = y) > 


-œ J(z)@g(e—y) e 


observe that the integrand corresponds to the tradi- 
tional Jaccard index adapted to cope also with negative 
multiplicities, here called negative multiset Jaccard index. 

The interiority index also needs to be adapted to pos- 
sibly negative multiplicities as; 


min {|f(x)| ,|9(%)|} 


The respective combination with the interiority index 


L(f(a), 9()) = (11) 


yields the negative multiset coincidence, written as: 


Cn (f(x), 9(@)) = In(F(@), 9(@)) TF), 9(")) (12) 


The multiset Jaccard index generalized to negative mul- 
tiplicities can be adapted for taking into account the sum 
of the two sets A and B instead of their respective union, 
which leads to the addition-based multiset Jaccard index: 


_ 22, min (f(x), 9(2)) 
Eia (F(x) + g(2)) 


with 0 < Js(f (x), g(x)) <1. 
As with the original Jaccard index, the addition-based 


Tal f(z), g(2)) (13) 


multiset Jaccard index can be combined with the interi- 
ority index, leading to the respective addition-based coin- 
cidence index: 


Ca(f(x), 9(@)) = Fal f(x), g(@)) TF (£), 9(@)) (14) 


Each of these indices lead to respective multifunction 
convolutions, which involve s sliding one function with 
respect to the other while calculating the respective index, 
followed by the respective integration. 

Table 1 summarizes the several similarity index under- 
lying the correlation/convolution methods that will be 
compared in the present work. 


[abbr [index [aininn] 
[Corr | Traditional cross-corvelation | Fai | 
[me | multifimetion convolution | Fas | 
[UN || Multisot Jaccard, neg. mult. | Ea 10 | 


[MC | Multiset coincidence, neg. mult. | Bq. 12| 
AJ || Addition-based multiset Jaccard | Ba 13 | 
[A7 | Addition-based multiset come. | Fa 14 | 





Table 1: A summary of the similarity indices underlying the cor- 
relation/convolution methods compared in the present work, also 





including their abbreviations and respective equations. 


3 Results 


Figure 1 presents the results of applying the several types 
of correlations/convolutions considered in the present 


work to the matching between a target (f(x) and a tem- 
plate (g(x)) function. 


As expected, the multifunction convolutions yielded 
substantially enhanced results regarding the identifica- 
tion of the peaks corresponding to the matches, leading to 
sharper peaks and attention of secondary matches, while 
the standard cross correlation resulted in peaks that are 
even wider than in the original target. 





Of particular interest is to observe the results of the 
interiority-based convolution, yielding two peaks that are, 
however, less sharp than those obtained for the other mul- 
tifunction convolutions. This interesting property con- 
tributed to the observed enhanced performance of the two 
coincidence index-based multifunction convolution meth- 
ods, which yielded the sharpest and narrowest matching 
peaks while almost eliminating the secondary matches. 

Subsequent results considered the incorporation of pro- 
gressive noise levels into the target function. More specifi- 
cally, we added noised points at each of the x values drawn 
from the symmetric, uniform density: 


n(x) = L x (rand(x) — 0.5) (15) 


where rand() is the uniform random distribution and 
L is the noise level. 

Figures 2 to 2 present the obtained results respectively 
to noise levels 0.2, 0.5, 1 and 2. 

It follows from the analysis of these results that all con- 
sidered methods are robust to the applied levels of noise. 
However, two effects are of particular importance. First, 
we have that the added noised implied in slight loss of 
sharpness in the case of all the multifunction methods. 
At the same time, the cross correlation accounted for the 
best robustness to noise. ‘These complementary features 
motivated the combination of these two types of methods 
as described in the following section. 


4 Combining Cross Correlation 


and Multifunction Convolutions 


The complementary abilities of the cross correlation 
and multifunction convolutions respectively to template 
matching and filtering can be combined so as to harness 
their respective best features. This can be immediately 
achieved by applying the multifunction methods after the 
two signals have been cross-correlated, with the result be- 
ing taken as the next target function. It is also possible 


(a) - f(x) 


(b) - g(x) 








(c) - Cross-Corr. 





= 
© S = 
O 
w 
S Oo 
= x 
(a) w 
re] i 
Q 
Q (=) 0 
7 = ~ 
0 1 2 3 4 5 6 0 1 2 4 5 6 0 1 2 3 4 5 6 
(d) - Multiset Conv. (e) - Multiset Jaccard Conv. (f) - Multiset Interiority 
O O 
N m N 
(=) 
= = 
= 
= = 
> F © 
Ge 
g o 
0 1 2 3 4 5 6 0 1 2 4 5 6 0 1 2 3 4 5 6 
(g) - Multiset Coinc. Conv. (h) - Add.-Mult. Conv. (i) - Add.-Mult. Coinc 
(=) © 
uz N 
© 
t+ Ww oO 
oO bau 
N 
= = o 
y 
N O 
F s 
ki 
0 1 2 3 4 5 6 0 1 2 4 5 6 0 1 2 3 4 5 6 


Figure 1: Comparison of the several multifunction convolution methods with respect to two noiseless functions (a) and (b). 


to apply low-pass filtering on the noise functions, but this 
may not be necessary in case the template function is it- 
self smooth as in the case of the current examples. 
Figure 6 illustrates the results obtained by application 
of the above proposed methodology on the functions in 
Figure 5, a situation which corresponds to the highest 
levels of noise considered in this work, and the obtained 





results corroborate the effectiveness of the approach. 


5 Concluding Remarks 





We have presented a comparison of several multifunc- 
tion convolutions applied to quantify the similarity be- 
tween two functions f(x) and g(x) according to increasing 
level of noise. This operation relates directly to template 
matching as well as filtering. The convolution methods 
consisted of the multifunction convolution as well as its 
adaptation with respect to the several similarity index 
described in [3]. 

The results can be understood to be markedly encour- 
aging and promising. First, we have that the multifunc- 
tion convolutions yield sharper peaks while attenuating 


secondary peaks. Therefore, the local similarity between 
the two functions can be effectively quantified by using 
the multifunction convolutions. Among the latter type 
of methods, we have that the multifunction convolution 
tended to have similar performance when compared to its 
normalized version and addition-based convolution. How- 
ever, the two approaches incorporating the interiority in- 
dex were capable of emphasizing even further the match- 
ing peaks while attenuating secondary matches. 

In case the secondary peaks need to be also identified, 
it is possible to employ a recursive procedure in which 
the largest peaks are removed from the target signal, and 
new detections involving the multifunction convolutions 
are employed. 

The application of the convolution methods in pres- 
ence of noise also yielded remarkable results, revealing 
a substantial robustness of the multifunction convolution 
methods up to relatively high levels of additive uniform 





noise. Nevertheless, the noise has been observed to ob- 
taining wider matching peaks, and also to affect the mul- 
tifunction convolutions slightly more than the traditional 
cross-correlation, which presented the best resilience to 
the considered type of noise. 
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(c) - Cross-Corr. 
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Figure 2: Comparison of the several multifunction convolution methods with respect to two noise level 0.2. 


The superior robustness of the cross-correlation can be 
used to define a new method in which the multifunction 
convolutions are applied not directly onto the target and 
template signals, but on their respective cross correla- 
tion. This method therefore combines both advantages 
of the cross-correlation (or cosine similarity-based meth- 
ods) with the enhanced performance of the multifunction 
convolutions for peak detection. 

The results reported in this work corroborate the po- 
tential of the multifunction convolutional methods for 
enhanced pattern recognition, filtering, as well as other 
related tasks. In addition to the observed good perfor- 
mance, we also have that the multifunction methods are 
conceptually, mathematically, and computationally sim- 
ple, requiring only comparisons between values and addi- 
tions instead of the products involved in the traditional 
cross-correlation and cosine distance-based methods. 

One point of particular interest is to contemplate to 
which extent similar methods could be employed in natu- 
ral recognition systems involving neuronal cells, as moti- 
vated by their relative simplicity and low computational 
cost. 

As future works, It would be interesting to consider 


other types of functions, as well as to study the effect of 
the relative function magnitudes and other types of noise 





on the results. Related research is being conducted and 
results are to be published opportunely. 
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Figure 4: Comparison of the several multifunction convolution methods with respect to two noise level 1. 
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Figure 5: Comparison of the several multifunction convolution methods with respect to two noise level 2. 
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Figure 6: Results of the combination of cross-correlation with multifunction convolutions. The cross correlation was first obtained between 





the target signal with level noise L = 2 and respective template function in Figure 5, then followed by the several considered methods. It can 





be readily observed that this respective methodology allowed the combination of the best characteristics of the traditional cross correlation 
(higher robustness to noise) with the enhanced peaks provided by the multifunction convolutions considered in the present work. 


